Apache Iceberg: The Definitive Guide by Tomer Shiran & Jason Hughes & Alex Merced & Dipankar Mazumdar

Author:Tomer Shiran & Jason Hughes & Alex Merced & Dipankar Mazumdar [Tomer Shiran]
Language: eng
Format: epub
Publisher: O'Reilly Media, Inc.
Published: 2024-02-25T00:00:00+00:00

Update the Catalog File to Commit Changes

Now, the engine goes to the catalog again to ensure no other snapshots were committed while this INSERT operation was being run. By doing this validation, Iceberg guarantees no interference in operations in a scenario where multiple writers write data concurrently. Iceberg makes sure that the one writing the data first will get committed first, and any conflicted write operation will go back to the previous steps and re-attempt until the write is successful or fails.

In the end, the engine atomically updates the catalog to refer to the new metadata v2.metadata.json, which now becomes the current metadata file.

A visual representation of what the Iceberg component hierarchy looks like at this stage is presented in Figure 3-3.

Download

Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.